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Noisy-Interference Sum-Rate Capacity for 
Vector Gaussian Interference Channels 
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Abstract 

New sufficient conditions for a vector Gaussian interference channel to achieve the sum-rate capacity 
by treating interference as noise are derived, which generahze the existing resuhs. More concise conditions 
for multiple-input-single-output, and single-input-multiple-output scenarios are obtained. 

I. Introduction 

The interference channel (IC) was first introduce by Shannon [1], and was later studied by Ahlswede 
[2] who gave a limiting expression for the capacity region. Determination of the single-letter expression 
of the capacity region of an IC has been a long standing open problem ever since. 

The first capacity region of the IC was obtained by Carleial in [3] for the very strong interference 
case, in which the capacity is achieved by decoding and subtracting the interference before decoding 
the useful signals. The Gaussian IC model with power constraint was also introduced in [3]. The result 
of [3] was later extended to discrete memory less ICs in [4]. In [5], Carleial showed that any Gaussian 
IC can be written in the standard form, i.e., both direct links have unit channel gain and the Gaussian 
noise has unit variance. An inner bound on the capacity region was obtained in [5] using superposition 
coding and sequential decoding. The best inner bound was obtained in [6] using superposition coding 
and joint decoding. This inner bound was later simplified in [7] and [8]. Early outer bounds on the 
capacity region of the IC can be found in [9], [10] and [11]. The capacity region of Gaussian IC with 
strong interference was obtained in [6] and [12], in which jointly decoding both the interference and the 
useful signal achieves the capacity. This result was extended to discrete memoryless ICs in [13]. The 

X. Shang is with Bell-Labs, Alcatel-Lucent, 791 Holmdel Rd., R-127, Holmdel, NJ, 07733. Email:xiaohu.shang@alcatel- 
lucent.com. H. V. Poor is with Princeton University, Department of Electrical Engineering, Princeton, NJ, 08544. Email: 
poor@princeton.edu. H. V. Poor was supported in part by the National Science Foundation under Grant CNS-09-05398. 



August 4, 2011 



DRAFT 



2 



degraded memoryless IC was studied in [14] and later in [15]. The degraded Gaussian IC was studied 
in [12] and the sum-rate capacity was obtained. It was shown in [16] that the capacity region of a 
Gaussian Z interference channel (ZIC) is equivalent to that of a degraded Gaussian IC. Therefore, the 
sum-rate capacity of a Gaussian ZIC is automatically obtained. The corner points of the capacity region 
of a Gaussian IC were also studied in [16] and this still remains an open problem [17]. In [18], it has 
been shown that Gaussian inputs do not achieve the capacity region of the Gaussian IC in the hmiting 
expression of [2]. 

In [19], two outer bounds on the capacity region were derived. The first bound is based on a genie- 
aided approach in which additional information is provided to the receivers. The second bound of [19] 
is obtained by allowing cooperation between transmitters. It was speculated in [19] that there might be 
other genies which give tighter outer bound than [19, Theorem 1]. In [20] another outer bound was 
derived using different genies. Using this bound, the Han and Kobayashi inner bound [6] is shown to be 
within 1 bit of the capacity region. Motivated by [20], new outer bounds were derived in [21]-[23] and 
it was shown that the sum-rate capacity is achieved by treating interference as noise if the IC satisfies 
a simple condition. This kind of Gaussian IC is said to have noisy interference. This noisy-interference 
sum-rate capacity is extended to multi-user Gaussian ICs in [23]-[25]. Meanwhile, the sum-rate capacity 
for Gaussian ICs with mix-interference was determined in [22] and [26] using [19, Theorem 1]. 

In this paper, we study the capacity of the two-user multiple-input multiple-output (MIMO) IC. As 
shown in Fig. 1, the received signals are defined as 

Vi = Hixi + F2X2 + zi 

y2 = H2X2 -I- Fiari -I- Z2 (1) 

where Xi,i = 1,2, is the transmitted (column) vector signal of user i which is subject to the average 
power constraint 

n 

Y,ir {E [xijxjj]) < nPi (2) 

where Xii,Xi2, . . . , Xin, is the transmitted vector sequence of user i, and Pi is the power constraint. The 
noise Zi is a Gaussian random vector with zero mean and identity covariance matrix; and Hj and Fj, 
i = 1,2, are the channel matrices known at both the transmitters and receivers. Transmitter i has U 
antennas and receiver i has rj antennas. Without loss of generahty, we assume Hj 7^ and Pi > 0. 

The capacity of a MIMO IC was first studied in [27] which derived an outer bound on the capacity 
region and determined the capacity region for the single-input-multiple-output (SIMO) IC with strong 
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Fig. 1. The two-user MIMO IC. 

interference. A lower bound for the sum-rate capacity based on Han and Kobayashi's region were 
discussed in [28]. Telatar and Tse [29] showed that Han and Kobayashi's region is within one bit per 
receive antenna of the capacity region. Recent work in [30] and [31] extended the existing capacity results 
from scalar ICs to MIMO ICs under average power constraints. Specifically, [30] and [31] derived the 
capacity region for aligned-strong interference, and the sum-rate capacity for aligned-strong Z interference, 
aligned-weak Z interference, noisy interference and mixed interference under average power constraints. 
In [31], we say that a MIMO IC has 

• aligned-strong interference if Hj = FjAj, i = 1,2; or aUgned strong Z interference: if Fi = and 
H2 = F2A2; 

• aligned-weak Z interference: if Fi = and F2 = H2A2; 

• noisy interference if [31, (36)-(39)] are satisfied for all Sj >: with tr(Si) < Pi; and 

• mixed interference if Hi = FiAi and F2 = H2A2; 

where Aj is a matrix satisfying Aj A^ ^ I, and I is an identity matrix. It can be shown that the capacity 
region of the SIMO IC with strong interference [27] is a special case of that of the ahgned-strong 
interference. Moreover, the capacity results for aligned-strong interference, ahgned-strong or aligned- 
weak Z interference and mixed-interference apply to other power constraints, e.g., a covariance matrix 
constraint, a peak power constraint and a per-antenna power constraint. 

The noisy-interference condition for MIMO ICs was later studied in [32] which requires only the 
optimal covariance matrices of Xi and X2 to satisfy the conditions [31, (36)-(39)], as long as these 
optimal covariance matrices are of full rank. An application of this result is the noisy-interference sum- 
rate capacity for symmetric SIMO ICs, i.e., H, and Fj are column vectors with Hi = H2 and Fi = F2 
and the power constraints are identical Pi = P2- 

The results of [31] and [32] on the MIMO IC with noisy interference obtain different power regions. 
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Intuitively, [31] obtains the low power region of the noisy interference and [32] obtains the comparatively 
high power region of the noisy interference. The reason is that, [31] requires the power to be low enough 
such that any power allocation satisfies conditions [31, (36)-(39)]; while [32] requires the power to be 
high enough such that each eigen-mode is allocated non-zero power, and [31, (36)-(39)] are satisfied. 

There exist MIMO ICs with noisy interference but which are not in the categories of [31] or [32]. 
These MIMO ICs include the parallel Gaussian IC [33] in which Hj and Fj are diagonal matrices, and 
the symmetric multiple-input-single-output (MISO) IC [32] in which Hj and Fj are row vectors with 
Hi = H2 and Fi = F2 and the power constraints are identical Pi = P2. For the noisy-interference 
conditions of both the parallel Gaussian IC and the symmetric MISO IC, there may exist some power 
allocations that violate [31, (36)-(39)]. Furthermore, the optimal input covariance matrices for the parallel 
Gaussian IC can be singular, and the optimal input covariance matrices for the symmetric MISO IC is 
always rank-1. Therefore, neither [31] nor [32] applies to these two special cases. 

The major difficulty in the determination of the noisy-interference sum-rate capacity of a MIMO IC 
is that the characterization of the optimal input covariance matrices by treating interference as noise 
is needed in the derivation. However, these optimal input covariance matrices are unknown due to the 
non-convex nature of the optimization problem for maximizing the sum rate of single-user detection. In 
[31] all the possible input covariance matrices are required to satisfy some conditions. The results in [32] 
and [33], although not requiring all the input covariance matrices to satisfy the conditions, they do have 
some assumptions, or have some knowledge on the optimal input covariance matrices: 

• Special MIMO ICs in [32] : the optimal input covariance matrices are assumed to be of full rank. 

• Parallel Gaussian IC in [33]: the optimal input covariance matrices are diagonal. More importantly, 
the optimal power allocated at each antenna satisfies the parallel supporting hyperplane condition, 
or in another words, the sum-rate function for each sub-channel has the same subgradient at the 
optimal power allocation. 

• Symmetric MISO IC in [32]: beamforming achieves the largest sum-rate for treating interference as 
noise. Thus the optimal input covariance matrices are both rank-1. The optimality of beamforming 
was proved in [34] and [35]. The same result was reproduced using different methods in [36] and 
[37]. By restricting to rank-1 matrices and using the assumption that the MISO IC is symmetric, the 
closed-form optimal input covariance matrices are obtained, which is crucial in deriving the noisy 
interference condition. 

In this paper, we revisit the sum-rate capacity of the MIMO IC and derive a new noisy-interference 
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condition, i.e., treating interference as noise achieves the sum-rate capacity. This new condition requires 
only the optimal input covariance matrices to satisfy [31, (36)-(39)] and an additional condition, but 
does not require the optimal input covariance matrices to be of full rank (when they are of full rank, 
this additional condition is automatically satisfied). Thus, this new noisy-interference condition includes 
those in [31] and [32] as special cases. In addition, this noisy-interference condition includes those of 
the parallel Gaussian IC [33] and the symmetric MISO IC [32] as special cases. More concise condition 
for the general asymmetric MISO or SIMO ICs are also obtained. 

The rest of the paper is organized as follows: the noisy-interference sum-rate capacity for the MIMO 
IC is obtained in Section 11; the MISO and SIMO ICs are discussed in Sections m and IV, respectively; 
numerical examples are given in Section V; and we conclude in Section VI. 

Before proceeding, we introduce some notation that will be used in the paper. 

• Italic letters (e.g. X) denote scalars; and bold letters x and X denote column vectors and matrices, 
respectively. 

• I denotes the identity matrix and denotes the all-zero vector or matrix. The dimensions of I and 
are determined by the context. 

• |X|, X^, X~^ and rank(X) denote respectively the determinant, transpose, inverse, and rank of the 
matrix X, and ||x|| denotes the Euchdean vector norm of 

• radius(X) is the numerical radius [38, p. 321] of the square real matrix X, and is defined as 

radius (X) = max abs (a^Xa) , 

Q;Ta<i ^ ' 

where a is a vector, and abs(-) denotes the absolute value. 

• ar" = [a;f ,X2^, . . . ,a;^]^ is a long vector that consists of a sequence of vectors Xi,i = 1, . . . ,n. 
diag[Xi, • • • ,Xn] is a diagonal matrix with diagonal entries Xj. 

• Vec (A) denote the vectorization operator, i.e., let A = [ai, a2, • • • , a„], and a^, z = 1, • • • , n be the 
column vectors, then Vec (A) = [aj, aj, • • • , a^]-^. 

• a; ~ Ar(0,S) means that the random vector x has Gaussian distribution with zero mean and 
covariance matrix S. 

• E[-] denotes expectation; Cov(-) denotes covariance matrix; /(•; •) denotes mutual information; h{-) 
denotes differential entropy with the logarithm base e, and log(-) = loge(-). 

II. MIMO ICS 

We first derive a lower bound and an upper bound on the sum-rate capacity. The lower bound is 
simply the single-user detection sum rate. The upper bound is obtained by providing the receivers with 



August 4, 2011 



DRAFT 



6 



appropriate side information. Both the lower and upper bounds are formulated as optimization problems 
in which the lower bound is a non-convex problem and the upper bound is a convex problem. The sum- 
rate capacity is obtained by determining conditions under which these two optimization problems have 
the same solution. 



A. Lower bound on the sum-rate capacity 

By treating interference as noise, the maximum of the following optimization problem is a lower bound 
on the sum-rate capacity: 



1 



max - loe; 
2 ^ 



I + HiSiHf (l + FsSsFl^)"^ 
subject to tr(Si) < Pi, tr(S2) < P2 
Si ^0, 82^ 0. 



I + H2S2H^(l + FiSiFf) ^ 



(3) 



The following lemma gives the necessary Karush-Kuhn-Tucker (KKT) conditions for the optimal input 
covariance matrices S*, z = 1,2. 

Lemma 1: Let and S\ be optimal for problem (3), if Pi,P2 > 0, then there exist scalars Aj and 
matrices Wj, i = 1,2, such that 



Gi + A1I- Wi = 

G2 + A2I - W2 = 

^ >0 iftr(S*) = Pi 
Xi< 1 = 1,2 

= iftr(S*)<Pi 



where 



dRii 



dSi 
dRii 



dS2 

dR2i 
dS 



Gi 
G2 

s.=s* 
s.=s* 

Si=S* 



tr(S*W, 


= 0, 




dRii 




dR2i 




dSi 


Si=S' 


dSi 




dRu 




dR2i 




dS2 


Si=S* 


dS2 


Si= 



-Hf (l + HiS^Hf + F2S^Fi^) Hi 



(I + F2S^f1^) '-(l + HiStHl^ + F2S^Fl^) 
(I + FiS^Ff ) - (I + H2S^Hi^ + FiS^Ff ) 



-;f 



(4) 
(5) 

(6) 

(7) 

(8) 
(9) 
(10) 

(11) 
(12) 
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jHi^(l + H2S^Hi^ + FiSlFf) 



and 



I + HiSiHf (l + FaSaFl^) 



T\-i 



Ru (Si, 82) = -log 
R21 (Si, S2) = ^ log |l + H2S2H^ (I + FiSiFf ) 



(13) 

(14) 
(15) 



Proof: Conditions (4)-(7) are the KKT conditions for problem (3). Here, we only need to prove that 
problem (3) satisfies some constraint quahfications denoted by CQ5 in [39, p. 306] such that Aj and Wj 
do exist. The rest of the proof is included in Appendix A. ■ 

B. Upper bound on the sum-rate capacity 

The following is an upper bound on the sum-rate capacity of a MIMO IC. 

Theorem 1: The sum-rate capacity of the MIMO IC is upper bounded by the maximum achieved in 
the following optimization problem: 



max - log 
2 ^ 











T 


/ 












Hi 




Hi 




F2 




F2 




1 + 


Si 




El + 




S2 




1 




Fi_ 




Fi_ 

















-1 











T 














H2 




H2 






Fi 





Fi 





1 + 


F2_ 


S2 


F2_ 


1 


E2 + 


Si 





subject to tr(Si) < Pi, ti-(S2) < P2 
Si t 0, S2 ^ 

where Ej, z = 1, 2, can be any symmetric positive definite matrix satisfying 



E, 



I Ai 

AT 5],: 



>- 



El ^ I - A9S.7'A 



2^2 



-1 aT 



5:2 ^ I- AiI]^^Af. 



(16) 

(17) 

(18) 
(19) 



Proof: Let n",z = 1,2, be a length-n sequence of independent and identically distributed (i.i.d.) 
Gaussian vectors, each having joint distribution with Zi given by 

Zi 



M{0,^i)=M 0, 





I Ai 






Af 



(20) 
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Let be the input sequence of user i, and 



^Cow {xij) = nSi 
i=i 

tr(Si) < Pi 



(21) 
(22) 



Let e > and e — > when n ^ oo. Then for any achievable rate Ri and R2, we have 

n{Ri + — ne 

< I (x^ ; Hia:^ + F2X^ + z'l) + 1 {x^; Hsx^ + F^x^l + z^) 

< I (ar? ; Hix? + F2X? + «^ FiX? + <) + 7 (ar^; HsX? + FiX? + Fsrc? + n?) 
= /i (Fia;^ + O - «) + /i (Hix^ + Fsx^ + |Fia;^ + - /i (Fsx^ + K) 

+/i (F2X^ + n^) - /t (n^) + /i (Haar^ + Fix^ + z^lFaX^ + n^) - /i (Fix^ + z^|n^) 

(a) 

< h (FiXi + O - nh im) + nh (HiXig + F2X2G + Zi\FiXig + ni)-h {F2X2 + «i K ) 
+/i (F2X^ + n^) - n/i (712) + n/i (H2X2G + Fi^ic + ^2|F2a;2G +n2)-h {Fix^ + z^\n^) 

(b) 

< nh (FiXiG +ni) -nh{ni) + nh (HiXig + F2X2G + I'PiXig + ni) - n/t (F2X2G + -Zi |«i) 
+n/i (F2X2G + n2) - nh (11,2) + nh (H2X2G + FiXig + 22IF2X2G + "2) - nh (FiXig + Z2|«2j(23) 

(24) 

where in (a) we define Xio ~ M (0, Sj) and the inequality is by [31, Lemma 2], and (b) is by (18), (19) 
and [31, Lemma 3]. ■ 
The following lemma establishes the convexity of the optimization problem (16) and the proof is 
included in Appendix B. 

Lemma 2: The optimization problem (16) is a convex optimization problem. 

Theorem 1 is derived using the same method that has been used in [31]. The maximum achieved in 
problem (16) for any choice of Aj and 5]j that satisfy (17)-(19) is an upper bound on the sum-rate 
capacity of this MIMO IC regardless of whether it has noisy interference or not. 

C. Sum-rate capacity 

When the MIMO IC has noisy interference, we can choose appropriate Aj and Sj such that the lower 
and upper bounds converge. Before proceeding, we first introduce the following matrix identity which 
will be used repeatedly in the proof of our main result. 





Hi 




F2 






j + nl ^xig; 


H2 




Fi 




Z2 


^a^iG; 




XlG + 




X2G + 






X2G + 




XlG + 






_Fi_ 









ni 




_F2_ 









n2 
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Lemma 3: Assuming all the matrices have feasible dimension and the relevant matrices are invertible, 
we have 







-1 








All 


A12 




Ar/ 


+ 


A1/A12 








A21 


A22 









-I 



(A22 - A21A1/A12) ^ 



A2iAr/ -I 



• (25) 



Proof: 

All A12 
A21 A22 



(a) 



(6) 



[All - Ai2A22^A2l) 



-A^/Ai2 (A22 - A2iA^/Ai2) ^ 

- (A22 - A21 A^jj^ A12) A21 Aj;/ (A22 - A21 A^jj^ A12) 

An + An A12 (A22 - A21 A]"/ A12) ~^ A21 A];"/ - A5f/ A12 (A22 - A21 A^^J^ A12) 
- (A22 - A21 A]"/ A12) A21 A]"/ (A22 - A21 A]"/ A12) 



-^11 





+ 


A1/A12 












-I 



(A22 - A21A1/A12) ^ 



A2iAr/ 



where (a) is by the block matrix inversion lemma [38, p. 18], and (b) is by the Woodbury matrix identity 
[38, p. 19]: 

(C + UBV)~^ = - C-^U (B-^ + VC-^U)"^ VC-^ 



(26) 



The noisy-interference sum-rate capacity of a MIMO IC is obtained in the following theorem: 
Theorem 2: For the MIMO IC defined in (1) and Pj > 0, z = 1, 2, if the optimal solution of problem 
(3) has tr (S*) > 0, and there exist matrices Aj and Ej that satisfy (17)-(19) and 

S^Ff = Hf (I + ¥2Sl¥ly^ Ai (27) 

S^Fj = S^Hi^ (I + FiS^Ff ) A2 (28) 

Wi > Oi (29) 

W2 h O2 (30) 



where 



Wi = Gi 

W2 = G2 



tr(StGi) 
Pi 

tr(S^G2) 



(31) 
(32) 
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Oi 



1 T r 

Aj (I + FsS^Fi^) Hi - Fi El - Af (l + FsS^F^^) ~' Ai 



Af (l + F2S^Fl^) 'Hi-Fi 
Al (I + FiS^Ff ) H2 - Fs] - Ai^ (I + FiS^Ff ) A2 

Al (l + FiStFf)^'H2-F2 



02 = 



(33) 



(34) 



and Gi and G2 are defined in (8) and (9), respectively, then the sum-rate capacity is the maximum in 
problem (3) and is achieved by Gaussian input s* ~ AT (0, S*) and treating interference as noise. 

Proof: It suffices to show that under conditions (17)-(19) and (27)-(30), the upper bound on the sum- 
rate capacity, i.e., the maximum in problem (16) for the given A, and Sj, is the same as the maximum 
in problem (3); and the maximum in (16) is also achieved by S*. 

The proof has two stages. In stage one, we rewrite the objective function of problem (16) and show 
that this objective function, by choosing = S^, equals the maximum achieved in problem (3). In stage 
two, we compare the KKT conditions of problems (3) and (16), and show that if the conditions in this 
theorem are all satisfied, then problem (16) is solved by the same S* that maximizes (3). 

Define 



Rlu (81,82) = ^log 



R2u (81, 82) = -log 











T 














Hi 




Hi 






F2 




F2 




1 + 


Si 


1 


El + 




S2 








Fi_ 




Fi_ 
























T 














H2 




H2 






Fi 




Fi 




1 + 




S2 




1 


E2 + 


Si 


-1 




F2_ 




F2_ 

















(35) 



(36) 



Before proceeding, we first show the following equality since it will be used repeatedly in the sequel: 





T 














Hi 










-1 


Hi 


_Fi_ 














Fi_ 



(a) 





T r 


Hi 




_Fi_ 






T 


Hi 




_Fi_ 





I + F,S,FJ 



A, 



-1 






Hi 




_Fi_ 



I + F,S,Fj) 




-1 



+ 



;i+F,s,Fj)- 

-I 



Ei - Af (I + F.S.Fj) Ai] [Af (l + F,S,Fj) -I 



H, 
Fi 
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Hf(l + F,S,Fj) 'h,+ 



Af(l + F,S,Fj) 'h^-F, 



Si - Af (I + F,S,fJ) 'a,J ' [aJ {I + FjSjFJ) Ui-Fi 

= Hf (I + F,S,fJ) ~' H, + 20i (37) 

where (a) is by Lemma 3, i,j G {1,2}, and i 7^ j, and we define Oj in tlie same way as in (33) and 
(34) by replacing S* with Sj. 
We first show Ra (S^, S^) = Riu (S^, S^): 

Riu (Si, S2) 



(a) 1, 
= - log 
2 ^ 



I + Si 





T 












-1 






Hi 






F2 




F2 




Hi 




1 


El + 




S2 










Fi 














) 




Fi 





(6) 1 , 

2 ^ 



I + SiHf (I + F2S2Fi^) ^Hi + 2SiOi 
where (a) is by the matrix identity 

|I + CD| = |I + DC| 



and (b) is from (37). Similarly, we have 

1 



R2u (Si, S2) = ^ log I + SsHi^ (I + FiSiFf ) ' H2 + 2S2O2 



Since (27) and (28) imply 



s;Oi = 



then we immediately have 



1 



i?i„ (St, S^) = - log I + StHf (I + F2S^Fl^) H: 



(38) 



(39) 



(40) 



(41) 



I + HiS^Hf (I + F2S^Fl^) ^ 

= RidSl,Sl) (42) 

where the second equahty is by (39). Similarly, we have 

R2um,S*2) = R2iiSl,S*^). (43) 

Next, we prove that the maximum in problem (16) is achieved when Sj = S*. Since by Lemma 2, 
problem (16) is a convex optimization problem, it suffices to prove that there exist Lagrangian multiphers 
Xi and Wi such that the following KKT conditions are satisfied: 

+ All - Wi = (44) 



dR 



lu 



dSi 



dR 



■2u 



Si=S* 



5Si 



Si=S* 
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"as. 



lu 



■2u 



Si=S' 



dR2, 

as. 



+ A2I - W2 = 



_ l>0 iftr(S*) = P, 
'1=0 iftr(S*)<P, 
tr (S* Wi) =0, Wi> 0. 



1,2 



We first compute 

dRiu 



5Si 



S«=S' 



(a) 1 9 



(6) 



(c) 



(d) 



if) 
(9) 



2 aSi 



log 



I + Si 



Hi 
Fi 



El + 



F2 




F2 




Hi 
Fi 



Si=St 





T 














Hi 






F2 




F2 




Hi 


1 


El + 








_Fi_ 
















Fi_ 



/ 


















Hi 


7 


F2 




F2 




Hi 




i + si 


Ei + 








-1 


) 


\ 


_Fi_ 














Fi_ 





Hi 


T 


I + F2S^F^ Ai 


-1 


Hi 


_Fi_ 




Af Si_ 




Fi_ 


Hi 


T 


I + F2S^Fl^ Ai 


-1 


Hi 


Fi 




Af Si_ 




Fi 



(l + (nf (I + F2S^Fi^) ^ Hi + 2O1 
(l + SJHf (I + F2S^Fi^) Hi) 



i (nf (I + F2S^Fi^) Hi + 2O1) (l + Hf (I + FaS^Fi^) Hi) 
= - ^Hf (I + F2S;f1^) Hi (l + SlUf (I + F2S;Fi^) Hi) 
-Oi (l + SlHj (I + F2S^F^) Hi) 

-Inf (I + F2S^Fl^) Hi (i + sinj (I + F2S^F^) Hi) 



-Oi (l - S^Hf (I + F2S^F^ + HiS^Hf)"' Hi 
-^Hf (I + FsS^Fl^)"' Hi (l + S^Hf (I + F2S;f1^)"' Hi)"' - Oi 
-inf (I + F2S^Fl^)"' (l + HiS^Hf (I + F2S^Fl^)"y ' Hi - Oi 
- Jnf (I + HiS^Hf + F2S;Fi^) Hi - Oi 
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1 d 



2 dSi 

dRii 



dSi 



[log (I + HiSiHf + FaSaF^) - log (I + FsSaF^)] 
-Oi 



-Oi 



(48) 



s,=s* 



where (a) is by the matrix identity (39), (b) and (d) are both by (37), (c) and (f) are both by (41), (e) is 
by the Woodbury matrix identity (26), and (g) is by the matrix identity [40, p. 151]: 



C (I + DC)~^ = (I + CD)~^ C. 



(49) 



Then we compute 

dRiu 



dS-, 



1 d 



s.=s* 



2 as. 



log 











T 








T 














Hi 




Hi 




F2 




F2 








F2 




F2 


El + 


Si 


+ 




S2 






- log 


El + 




S2 






Fi 




Fi 



























T 



s<=s* 















T 












F2 






Hi 


SJ 


Hi 




F2 




F2 




F2 




1 


El + 


+ 

















Fi 




Fi 




















T 












-i 




F2 


1 


El + 


F2 


s^ 


F2 




F2 

















) 


























F2 


T 


I + HiS^Hf 


+ F2S^Fi^ 


HiSJFf + Ai 


-1 


Hi 


SI 


Hi 


T 


2 







FiS^^Hf 


+ Af 


FiSJFf + 5]i 




Fi 


Fi 





I + FsS^F^^ Ai 


-1 


F2 


AJ Si 








(J 1 

2 



F2 





I + HiS^Hf + F2S^Fi^ 
FiSlHf + Af 

(l + F2S*Fi^)-' 







+ 



HiS^Ff + Ai 
FiSJFf + Si 

^I + F2S^Fi^)-'Ai 



- -1 








T 




Hi 


SI 


Hi 










Fi 




Fi 





(Si - Af (I + F2S^f1^) 'Ai) 



Af (I + F2S^Fi^) 



-1 



F2 





(c) 1 


F2 


T 


I + HiS^Hf + FaS^Fi^ HiS^Ff + Ai 


-1 


Hi 


2 







FiS^Hf + Af FiS^Ff + Si 




Fi 



S^Hf (I + FsS^F^) ^F2 
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(cO 1 


F2 




(I + HiS^Hf + FsS^Fi^) 


2 















+ 



^ + Si - (FiS^Hf + Af ) (I + HiS^Hf + FsS^Fi^) ' (FiS^Hf + Af )^ 



(FiS^F^ 

(FiS^Hf + Af ) (I + HiS^Hf + FaS^F^^) 
= ^F^ (I + HiS^Hf + FaS^F^^) HiS^Hf (I + FsS^F^^) F2 



I + HiS^Hf + F2S|F^) ^(HiSJFf + Ai) 
-I 

1 



Hi 
Fi 



S^Hf (I + F2S^F^) 'f2 







T r 


1 


F2 




+ 2 














(I + HiS^Hf + FsS^Fi^) ^(HiS^Ff + Ai) 
-I 



(FiS^F? 



^ + Si- (FiS^Hf + Af) (l + HiS^Hf + F2S^f1^) ^ (FiS^Hf + Af 



(FiS^Hf + Aj) (I + HiS^Hf + F2S^Fl^)"' Hi - Fi) S^Hf (l + F2S^f1^)~' F2 
^F^ (I + HiS^Hf + F2S^Fi^) HiS^Hf (l + F2S^f1^) F2 
—F'^ (I + HiS^Hf + F2S^Fi^)-' F2 + ^F^ (l + F2S^Fi^)-' F2 



1 d 



2 dS2 
dRii 



[log (I + HiSiHf + F2S2Fi^) - log (I + F2S2Fl^)] 



Si=Si 



dS-2 



(50) 



Si=St 



where both (a) and (f) are from the matrix identity 

C-i - D"^ = C"^ (D - C) D-\ 



(51) 



equality (b) and (d) are both from Lemma 3, (c) is directly from (27), and (e) is also from (27) which 
implies 

((FiS^Hf + Aj) (I + HiS^Hf + F2S^Fl^)-' Hi - Fi) 

= (Af (I + F2S^f1^)"' HiSiHf + Af ) (I + HiS^Hf + F2S^Fi^) HiS^ - FiS^ 
= Af (I + F2S^Fi^)"^ HiSt - FiSt 

= 0. (52) 



Similarly, we have 



dR2u 



Si— 



dR2i 
9Si 



(53) 



Si=S* 



August 4, 2011 



DRAFT 



15 



dR 



■2u 



dR2i 



-Oo. 



Si=S* 



By (4) and (7), we have 



Thus, by (6) we have 



and hence from (4) and (5) we have 



S*Gi + XiS* = 0. 



A,; 



tr(S*G,) 



tr(S*G,), 



i.e., the Wj's defined in (31) and (32) are the Lagrangian multipliers in (4) and (5). 
Then, we choose 



Ai — Aj 



O, 



such that 



dR 



lu 



dSi 



dR 



2u 



Si=S* 



dSi 



+ All- Wi 



dRii 



dSi 



Si=S* 
S.=S* 



+ All - (Wi - Oi 



Si=S* 



= 



(54) 



(55) 



(56) 



(57) 



(58) 
(59) 



(60) 



where the last equality is from (4). Therefore, condition (44) is satisfied. Similarly, condition (45) is also 
satisfied. Condition (46) is satisfied because of (6), and condition (47) is satisfied by the assumptions 
(29) and (30) and conditions (27) and (28) which imply 



S*W, = S*(W,-Oi 



-s*o, 







(61) 



where in the second equality, we use the fact that S*Wi = when tr(S*Wi) = and S* ^ 
and Wj y 0. Therefore, there exist Lagrangian multipliers such that S* satisfies the KKT conditions 
for problem (16). Since problem (16) is a convex optimization problem, S* achieves the maximum in 
problem (16). By (42) and (43), we conclude that the maximum in (3) is the sum-rate capacity of the 
MIMO IC. ■ 
Remark 1: On comparing the upper bound function R^i in (38) and (40) with the lower bound function 
in (14) and (15), respectively, we note that there is an extra term 2SjOi in the logarithm function. It 
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is obvious that Oj ^ under conditions (18) and (19). Although 2SiOi may not necessary be a semi- 
positive definite matrix, this extra term still increases the rate upon Rn, e.g., 



Riu = ^ log 



I + SiHf (I + FsSsF^^) ^Hi + 2SiOi 



log 



I + Sf (Hf (l + FaSsFl^) 'Hi + 20i)Sf 



I + Sf Hf (I + FaSaFi^) ^ HiSf 



1 



log 



2 

Rii- 



I + HiSiHf (l + FsSaFl^) 



Conditions (27) and (28) are sufficient conditions for (41) to hold, which makes the lower and upper 
bounds converge. This extra term 28^0 j is also considered in the scaler Gaussian IC [21, p. 696] and 
the parallel Gaussian IC [33, eq. (64)], in which we have = for both cases. Furthermore, conditions 
(27) and (28) also mean that [31, Lemma 5] 

HiX-G + FjXjG + Zi^ FiX*G + Ui i,j e{l,2},i^ j 

form a Markov chain, where x*q ~ AA(0, S*). 

Remark 2: When all the conditions in Theorem 2 are satisfied, the optimal input covariance matrix 
S* and the corresponding auxiliary matrix E* in (17) (obtained by replacing Sj and A, with S* and 
A* associated with S*), form a saddle point of the upper bound function defined as 

-Rsu(Si,Ej) = i?i„(Si,Ej) + i?2u(Si,Ej) 

where (Sj, Ej) is defined in (38) and (40). We use this expression in this remark to emphasize that 
Ej is also a parameter. 

To show that this optimal solution is the saddle point, we first have 

mill max «s„(Si,Ei) < max i?5„(Sj, E*) = i?s„(S*, E*) 

E, tr(S.)<P. tr(SO<Pi 

where the second equality is by the existence of the Lagrangian multiplier satisfying the KKT conditions, 
and the convexity of Rsu{Si,Ei^) over S^, which imply that i?su(Si,E|) is maximized by S|. On the 
other hand, we have 

max minRsuiSi, E^) > mini?,„(S- , Ej) = i?,„(S*, E*) 

tr(Si)<Pi Ei Ei 

where the second inequahty is by (41). Since the following is always true 

min max i?s„(Sj,Ej)> max mini?su(Si, Ej) 

Ei tr(SO<Pi tr(SO<Pi 
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we have 

min max i2su(Si,Ej)= max mini?ct,(Sj, Ej) = i?su(S*, E*). 

By [39, Proposition 2.6.1 p. 132], (S*,E*) is the saddle point of Rsu (Si,Ej). 

Remark 3: Denote by Sj the covariance matrix constraint in [31, Theorem 6] and denote by Ej the 
corresponding auxiliary matrix consisting of Aj and S!j for this Sj that satisfy condition (17)-(19), (27) 
and (28). If all the conditions in [31, Theorem 6] are satisfied, i.e., for any ^ Sj ^ Sj there exist 
corresponding Aj and Xlj such that (17)-(19), (27) and (28) are satisfied, then (Sj,Ej) is also a saddle 
point of the upper bound function according to the covariance matrix constraint. This can be shown in 
a similar way as the result in Remark 2. First, we have 

max_ mini?su(Si,Ei) = max_ i?s„(Si, Ej(Si)) = i?5„(Si, A,) 

0<Si<Si Ei O^Si^Si 

where the first equahty is by the assumption of existence of Aj and Xlj that satisfy condition (17)-(19), 
(27) and (28) for each feasible Sj, and we denote such auxiUary matrix Ej as Ej(Si). The second equaUty 
is by the fact that Rgu is an increasing function of Sj. On the other hand, we have 

min max i?s«(Si,Ei) = mini?s„(Si, Ej) = i?s„(Si,Ej). 
Ei Si^Si E* 



Therefore, we also have 



max mini?su(Si, Ej) = min max i?su(Sj, Ej 
Si^Si Ei Ei Si<Si 



By [39, Proposition 2.6.1 p. 132], (Sj,Ej) is also a saddle point for i?su(Sj,Ej) according to the 
covariance matrix constraint. Therefore, [31, Theorem 6] parallels Theorem 2 in the covariance matrix 
constraint. 

Remark 4: Theorem 2 includes [32, Theorem 1] as a special case. In [32, Theorem 1], it was shown 
that if the S* is full rank and there exist Aj and Sj satisfying (17)-(18), (27) and (28), then this MIMO 
IC has noisy interference. In this case, (27) and (28) imply 

Ff = Hf (I + F,S*Fj)-' Aj, i,j G {1, 2}, i + j 

and thus 

Oj = 0. 

Therefore, (29) and (30) are both satisfied since Wj y has been shown in Lemma 1. 

Remark 5: Theorem 2 includes the noisy-interference sum-rate capacity result for the parallel IC in 
[33] as a special case. The parallel IC is a special MIMO IC with diagonal channel matrices Hj = 
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diag [hii , • • • , hit] and Fj = diag [fn , • • • ,fit]. We define the zth subchannel as that consisting of only 
the ith transmit and receive antennas. The lower bound in (3) for this channel, by choosing the diagonal 
input covariance matrix Sj can be written as 

t 

max RsiiSi) = ^ rj (sy , S2j) 
t 

subject to ^^Sjj < Pi, Sij > 0, i = 1,2. (62) 

where 

r, = ^ log (l + + i log (l + . (63) 

However, in [33] the lower bound on the sum-rate capacity is not formulated as above, but as 

t 

max "^Cj {sij,S2j) 
i=i 
t 

subject to ^ Sij < Pi, Sij > 0, i = 1,2 (64) 

i=i 

where Sij denotes the power allocated to the jth subchannel for user i, and Cj {sij,S2j) denotes the 
sum-rate capacity of the jth subchannel under power constraint Sij, i.e., power Sij is allocated to the jth 
transmit antenna of user i. The upper bound on the sum-rate capacity is also formulated via optimization 
problem (16). However, if we choose the auxiliary matrices Aj and Sj as in [33, eqs.(41) and (42)], 
then the upper bound can be written as 

t 

max Rsu{Si) = ^ fj {sij,S2j) 
i=i 

t 

subject to tr(Si) = ^ Sij < Pi, Sij > 0, i = 1,2. (65) 

i=i 

where Sj = diag[sji, • • • , Sj and fj{-) is defined in [33, eq.(64)]. The auxiliary matrix Ej is the same 
in both upper bounds. Therefore, [33] uses exactly the same side information as that in Theorem 2. 
Moreover, [33] shows that the matrices and Xl* are both diagonal matrices (see Ej in [33, eqs. (41) 
and (42)]). Thus, the upper bound Rsu{Si) is the sum of the upper bound for each subchannel fj. 

It has been shown in [33] that if the power constraint Pi is in the set [33, eq. (18)], then by [33, Theorem 
3] this parallel IC has noisy interference and the optimal input covariance matrix S* = diag[s*i, ■ ■ ■ , s*^.] 

has the properties [33, eqs. (18), (74) and (75)] 

t 

e f]dCj {sij, s*2j)y^ empty (66) 
i=i 



Ai 

A2 
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dsn 



'23 = "23 



dsii 



'13 = "13 

'23 = »23 



9rj 



'13 - "ij 

'23 = »23 



for alH = 1, 2, j = 1, - ■ ■ ,t 



(67) 



where dCj [sij,S2j 



is the subdifferential of Cj {sij,S2j) at (^Sij,'S2j^, and [Ai, A2]"^ is the common 
subgradient shared by all the subdifferentials. From the expression of dCj ^Sij,S2j) ^ [^3, eq. (100)], 
we have 







" drj 




Ai 




dsij 




A2_ 












_ ds2j 


«.3=«i3- 



+ 



W2j 



i = l,2, j = l,---,t 



(68) 



where wij and W2j are nonnegative constants. Hence, we have 

ORsi 



where Wj = diag[it;ii, 



, Wit] h 0. By (67), we have 



dR 



si 



Si — 8x582 — S2 



dSi 



(69) 



(70) 



Si — S^ ,82 — 82 



which implies Oj = 0. Therefore, if a parallel IC satisfies the noisy-interference condition in [33], it 
also satisfies Theorem 2. The lower bound maxi?^/ and the upper bound maxi?^^ are optimized at 
the same S* with the same Lagrangian multipliers. The Lagrangian multipliers Aj associated with the 
power constraint tr(Sj) < Pi form the common subgradient of all the individual subchannel capacities 
Cj (as well as the individual lower bounds rj) and upper bounds fj, i.e., Cj (or rj) and fj have parallel 
supporting hyperplanes with the subgradient [Ai, A2]^ at the optimal power allocation point. 

We note that to formulate the lower bound as in (64) is important for [33] since the problem is then 
a convex optimization problem. Furthermore, condition (67) directly guarantees the optimahty of s*j for 
(64), and only through which we show the optimality of s*j for (62) [33]. 

Remark 6: Theorem 2 determines the noisy-interference sum-rate capacity for general MIMO ICs. 
When the MIMO IC reduces to a MISO or SIMO IC, the conditions in Theorem 2 can be simplified. We 
defer these results in Sections III and IV, respectively. In [32], noisy-interference sum-rate capacities of 
symmetric MISO and SIMO ICs are obtained, i.e., ICs with Hi = H2, Fi = F2, Pi = P2, and where 
all the Hj and Fj are column or row vectors. These two results are both included as special cases of 
Theorem 2. In Sections III and IV, the MISO and SIMO ICs can be symmetric and asymmetric. 

Remark 7: Equations (27) and (28) are special cases of the Sylvester equation [41]. Once S* is 
obtained, the matrix Aj can be obtained by solving the following hnear equations: 



{SIUJ (I + F2S^Fl^) ') Vec(Ai) = Vec (SjFf ) 
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I (g) (s^Hi^ (I + FiS^Ff )~^) Vec(A2) = Vec (S^F^) 

where (g) denotes the Kronecker product of matrices. Therefore, the existence of Aj can be determined 
by the theory of linear equations. 

Remark 8: In Theorem 2 and its proof, we need to determine the existence of a positive definite Sj. 
Sometimes the expression for is not important (e.g., the parallel Gaussian IC discussed in Remark 5, 
and the symmetric SIMO IC discussed later in Remark 14). If we choose equality in both (18) and (19), 
we obtain two matrix equations which are special cases of a discrete algebraic Ricatti equation [42]. The 
existence of a positive definite solution is determined by [31, Lemma 9] using [42], which requires, for 
both i = 1 and 2: 

radius (*i)<^ (71) 

where 

#1 = (I - Af Ai - As A^) ~^ AjA^ (I - AjAi - A2 A^^) ~^ (72) 
*2 = (I - Ai Af - Al^ A2) Aj Af (I - Ai Af - Ai^A2) . (73) 

Here we present a strengthened result of [31, Lemma 9] which requires (71) to be satisfied for only i = 1 
or z = 2. 

Lemma 4: For the following matrix equations for Si and S2: 

Xli = I - A2X;2 ^ A^ (74) 

S2 = I-AiSr^Af (75) 

if radius($i) < ^ or radius($2) < ^ where $j is defined in (72) and (73), then there exist symmetric 
positive definite solutions for Yli and Yl2- Moreover, the solutions for both i = 1 and 2 satisfy 

y AjAi (76) 

or equivalently 

^ I A 



T 



Aj S 



y 0. (77) 



The proof is included in Appendix C. 

For completeness, we give the noisy-interference condition of MIMO ZIC in the following proposition. 
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Proposition 1: For the MIMO IC defined in (1) with Fi = and Pj > 0, z = 1, 2, if the optimal 
solution of problem (3) has tr(S*) > 0, and there exist matrices A2 and E2 that satisfy 

I y A2A^ 
S2F2 = S2H2 A2 



W2 y O2 



where 



02 = ^ {A^H2 - (I - Al^A2)"' (Al^H2 - F2) 

and G2 are defined in (9), then the sum-rate capacity is the maximum in problem (3) and is achieved 
by Gaussian input ^ H (0, S|) and treating interference as noise. 

Proof: The proof is straightforward from Theorem 2 by choosing Ai = 0, Si = I — A2A^ and 
S2 = I. Condition (29) is automatically satisfied by Wi ^ = Oi. ■ 

Remark 9: The ahgned-weak interference condition in [31, Proposition 5] for the average power 
constraint is a special case of Proposition 1 . The ahgnment weak interference means that if there exists 
a matrix A2 with A2A^ < I and F2 = A^H2, then treating interference as noise achieves the sum-rate 
capacity. Obviously, in such a case, all the conditions in Proposition 1 are satisfied. 

In Sections 111 and IV, we apply Theorem 2 to MISO and SIMO channels and simphfy the noisy- 
interference conditions. 



III. MISO ICS 

In [32], it has been shown that the capacity of a two-user MISO IC is the same as that of a MISO 
IC with each transmitter having only two antennas. The main idea is to write the direct link channel 
vector as the sum of the interference channel vector and its orthogonal vector. The antenna reduction is 
also studied in [35] which shows that the single-user detection rate region of an m— user MISO IC with 
transmitter i,l <i < m, having ti antennas, is the same as that of a MISO IC with transmitter i, having 
only min{tj,m} antennas. The antenna reduction is performed systematically using [35, eqs.(45)-(47)] 
which can also be used to show the equivalence of the capacity regions between the original m-user 
MISO IC and the new m-user MISO IC after antenna reduction. In the following, we apply the method 
in [35] to the two-user MISO IC to show the reduction process. On letting Hj = and = , 
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z = 1, 2, in (1), the received signals of a MISO IC are 



Y2 =h2X2+ fi Xi + Z2 



(78) 



where hj and fj are t j x 1 column vectors and we write the transmitted signal as Xi with power constraint 
Pi. Define the singular value decomposition of /j as 

1 T 



,0 



(79) 



where UjUj^ = I and the dimension of the zero vector is ti — 1. Then we have 



cos 6i 



1 
Vi 



COS 9i 




(80) 



where we define 6i = Z [hi,fij, and is a (tj — 1) x 1 vector. Equality (a) follows from the fact that 
the first row of \jf is /j /||/j||. Equality (b) is by the fact llflfjH = hi sin 6i and the singular value 
decomposition 



9i = yi 



hi 



sin 6i, 



where Vj^Vj = I, and the dimension of the zero vector is U — 2. 
Define 

X = QjXj 



(81) 



where 



Qi 



1 
Vi 



vT. 



(82) 



It is obvious that Q Q = I. Then the received signals of the MISO IC can be written as 



X2 +Zi 











T 










hi 


cos 9i 






h 


Yi = 




hi 


sin^i 


Xi + 
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h2 
h2 



cos 02 






fi 


sin 02 


X2 + 














Xi +Z2. 



By removing irrelevant dimensions, we write the MISO IC in the following standard form: 

Yi = h^xi + flx2 + Zi 

Y2 = hlx2 + flxi + Z2 
where the dimension of all the vectors is 2, and the power constraint for user i is now Pi, and 

p — Aha -11^ 

^ I — 1 ||'*'Z II 

a,: 



hi 



\hiP 





cos 0i 
sin 0i 



(83) 

(84) 
(85) 

(86) 
(87) 



Consequently, if Sj is the input covariance matrix of user i for equivalent channel (83), the corresponding 
input covariance for the original channel is 



hi 



Q 



T 



2 ^* 



S. 




(88) 



With the antenna reduction, we have the following result. 

Theorem 3: For the MISO IC defined in (78) and its equivalent channel (83) with cos Z {hi,fi) ^ 0, 
f i ^ 0, hi 0, i = 1,2, denote S* as the optimal solution of problem (3) for the equivalent channel 
(83), if S* 7^ and 



a^>al i = l,2 



abs (^i) + abs (^2) < 1 



where 



^2 ^ 



{l + Al-Al) + J{l + Al-Aiy-AAl 



{l + Ai-Ai) + J{l + Al-Aiy-4Al 



(89) 
(90) 

(91) 
(92) 
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then the sum-rate capacity is the maximum of problem (3) and is achieved by treating interference as 
noise. 

Proof: We use Theorem 2 to prove the converse. We first consider the existence of Aj (i.e., Aj = Ai 
in the MISO case) in (27) and (28) which require 

Slf, = Slhi{l + flS*2hy' Ai (97) 

8*2/2 = S*2h2 (l + fJSlf.y A2. (98) 

It has been shown in [35] that rank(S|) < 1. With the assumption tr(ST) > 0, we have 

rank(S*) = l. (99) 

Then we can write 

s* = ial (100) 

where 7 is a 2 x 1 vector. We have 

TitT/i =7i7T/»i (1 + 7^8^/2) "'^1. (101) 

Obviously, if 7^/11 = 0, then 7^/1 = because otherwise transmitter 1 does not transmit anything 
to receiver 1 while still generating interference to receiver 2. In this case Ai can choose any value. If 
7^hi / 0, we have 

T f 

Ai = —. (102) 

7^/11 {i + flsy2) 

Therefore, Ai always exists. Similarly, we can show the existence of A2. Another expression of Ai in 
(95) and (96) is obtained by left-multiply (97) and (98) with hj and h^, respectively. 

We then consider the existence of 5], (i.e., = af in the MISO case) in (18) and (19). By choosing 
equality in both (18) and (19), we obtain af in (91) and (92). It can be shown that the existence of af, or 
equivalently, that (91) and (92) are feasible, is guaranteed by (90) (details can be found in [21, p. 696]). 
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It remains to consider whether conditions (29) and (30) are satisfied. In the following, we do not verify 
these two conditions directly from (31) or (32). Instead, we use the equivalent conditions (4)-(7) since 
we have additional information (99) for S*. 

From (7), the columns of Wj are all in the eigenvector space of S* associated with its zero eigenvalue. 
Since rank (S*) = 1 and S* is a 2 x 2 matrix, the dimension of this eigenvector space is 1. By (97), the 
eigenvector is Ai (l + f^^2f2j ~ fi- Therefore, there exist a constant > such that 

Wi = k (^yli (l + flSlS^) \i- /i) [a^ (l + ^ hi - /i) . (103) 

On the other hand, from (4) we have 

Wi = y '-^ ^ + ' / ■'^■'^ ^ + All. (104) 

2 (1 + hJS*hi + flS*f2) 2 (1 + fJSlfi) (1 + h^S*h2 + fJSlfi) 

On comparing the element of Wi on the first row and the second column in expression (103) and (104), 

we have 

From (33), we have 

(ai (1 + f^S*f2) hi - fi) (ai (1 + /^S*/^) hi - fi) 
Oi = 2^ ^-^2 —■ (106) 



Therefore, condition (29) requires 



k > -2 (107) 

^2 _ "^1 

which is equivalent to (89). Similarly, (89) guarantees that (30) is satisfied. Therefore, under conditions 
(89) and (90), all the requirements of Theorem 2 are satisfied, and the MISO IC has noisy interference. 

■ 

Remark 10: Consider the computation of the noisy-interference sum-rate capacity of a MISO IC. Using 
[35, Theorem 1], the maximum of problem (3) is 

1 , Pism^9i + pi4>i) \ , 1, /^/W^^2 + P2^\ 

max - log 1 H k H — log 1 H ^ (108) 

^,g[o,abs(f-0.)] 2 V 1 + 02^2 sin2 </,2 J 2 1 + aiPi sin^ J 
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where pi = 1 if 6i e [O, |] and pi = —1 otherwise. If (f)^ is optimal, then the corresponding input 



covanance matnx is 



S* = R 



Pi sm (pl cos (pj 

-,2 A* 



(109) 



sm 

pi sin (^J' cos 07 cos' 

A closed-form expression for (f)^ is difficult to obtain for the general MISO ICs, or even MISO ZICs. 
However, if the MISO IC is symmetric with 9i = 62 = 0, ai = a2 = a and Pi = P2 = P, then we have: 

1 



tan 4> = abs 



(110) 



{l + aP)t&ne J ■ 

Remark 11: If the MISO IC is symmetric as defined above, the noisy-interference condition is given 
in [32, Theorem 2], which can also be obtained from Theorem 3. In this case, the optimal S* is given 
in (109) and (110). Conditions in Theorem 3 reduce to 



2 2 cost' V / 



(111) 
(112) 



The above conditions are exactly [32, eq.(53)] which are satisfied under the conditions in [32, Theorem 
2]. 

Theorem 3 applies to the case in which cos^j 7^ and ||/j|| 7^ 0. If any of these two conditions are 
satisfied, the MISO IC reduces to a MISO ZIC. The noisy-interference sum-rate capacity is obtain in the 
following proposition. 

Proposition 2: For the MISO IC defined in (78) and its equivalent channel (83) with cos Z{hi,fi) = 
or fi = 0, denote by S^, i = 1,2, the optimal solution of problem (3) for the equivalent channel 
(83). If S* ^ and 



/2 S2/2 ^ ^2 S2/I2 



0-2 



/2 82^2 ( 1 + ^12^82^.2 



hlS*^h2 (l+/^8^/2) 

then the sum-rate capacity is the maximum in problem (3) and is achieved by treating interference as 



< COS^ 00 



(113) 
(114) 



noise. 



Proof: We first consider the case when fi = 0. From (91)-(96), we have 



l-Al 
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COS 6'2 V y S|/l2 

Ai = 

/2 82/1.2 

A2 = — ji . 

/12 S2/12 

Condition (113) guarantees that (90) is satisfied since 

/2_^2^| ^ /2 S2/2 ^jjg^ 
^1^82/12 / /i|^82/l2 

due to the fact that rank (82) = 1. Then it remains to consider (89) for i = 1, which is satisfied by (114) 
on the condition 

f2^h2 ^ Q 

COS 02 ~ 



which is true by (109): 



/2 83/12 , — „ sin^ ^2 cos 6*2 + P2 sin (f)^ cos 4>2 sin ^2 . ^ 

— 'a2-r2 > 0. 



COS U2 cos C/2 

In the case /i / but = f , the capacity region is outer bound by that of the same channel but 
with fi = 0. If (113) and (114) are satisfied, then the sum-rate capacity of the channel with /^^ = is 
an outer bound on that of the channel with /i 7^ but 0i = |. The achievability is due to the fact that 

/r8^/i=o 

since 

SI = Pihihi . 

We note that Proposition 2 can also be proved by Proposition 1. ■ 

IV. SIMOICS 

On letting Hj = hi and Fj = fi, i = 1, 2, in (1), the received signals of a MISO IC are 

§1 = hiXi + /2X2 + zi 

y2=h2X2+fiXi+Z2 (116) 
where hj and fj are ti x 1 vectors and we write the transmitted signal as Xi with power constraint Pi. 
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We can follow the same process (79)-(81) in Section m to find the equivalent channel for (116) with 
reduced number of antennas. The difference is that we need to replace the hi in (80) with hj where 
j 7^ i. Then we left-multiply with Qj and obtain the equivalent channel 



yi = hiXi + /2X2 + zi 

y2 = h2X2 + fiXi + Z2 

where the dimension of all the vectors is 2, the power constraint for user i is now Pi, and 

Pi = Pi 



\\hi 







(117) 

(118) 
(119) 

(120) 



(121) 



cos (fi 

sin ifi 

ipi = Z{hi,fj) i,j e {1,2}, jy^i. (122) 

We first present the noisy-interference sum-rate capacity of the SIMO ZIC as this is a special case of 
[31, Proposition 5]. 

Proposition 3: [31, Proposition 5] For the SIMO IC defined in (116) and its equivalent channel (117) 
with ip2 = § or = 0, if II/2II < \\h2\\, then the sum-rate capacity is 



(1 + ^2/2/2 



+ - log 
2 ^ 



I + P2h2hl 



(123) 



Proof: We first consider the case when fi = 0. Then from [31, Proposition 5], if there exists a matrix 
A2 such that 

/2 = A.'^h2 (124) 
1 1 A^A2 (125) 

then the sum-rate capacity is 



max — los 

0<Si<Pi,i=l,2 2 



1 + 



SihihJ (i + ^2/2/1^) 



-1 



T 



I + S2h2h2 



Then we can choose 



11^2 



2 _ f i,T 
2 — /2"2 



(126) 



(127) 
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and (124) is satisfied. For (125), we observe 

AlA2=f2(hlh2)fl 



as 




< I 



(128) 



where the last equahty is by the assumption II/2II < ||/i2||- 

Then we need to show that S* = Pi maximizes (126). On denoting the objective function of (126) by 
Rs, we have 



^ = ^^r(i+5i^i^T+ ^2/2/2) '^i>o 



(129) 



and 



dRs 
dSo 



= ^fl (l + SihihJ + 52/2/2 ) /2 - 2-^2 (l + ^2/2/2^ f2 + 2^2 (l + 'S'2/12^2 ) ^2 

- + -^2/2/^) /2 + ^^2 (l + S2h2h'^) h2 

- ~2 ("*" "^2/2^/2) /2 /2 + 2 ("*" S2hlh2^ /I2 ^2 



|/^2lP 



l/2f 



2(l + S2||/2P)(I + 52||fe2P) 

> 



(130) 



where (a) is by the matrix identity (49). Therefore Rg is maximized by S* = Pi. 

In the case when fi^O and (p2 = ^, the converse can be proved by assuming /^ = to ehminate the 

interference, and the achievability is proved by left-multiplying j/2 with /12 to null out the interference. 
We note that Proposition 3 can also be proved by Proposition 1 . ■ 
Theorem 4: For the SIMO IC defined in (116) and its equivalent channel (117), if for z = 1 or 2 



radius < - 



where 



*i = (I - Af Ai - A2Al^)"' AlAl (I - Af Ai - A2Aiy 
*2 = (I - AiAf - Al^A2)~' Al^Af (I - AiAf - a1^A2)' 
Ai (l + ^2/2/^) hi = fi 
A2 (l + Pi/i/T) h2 = f2 



(131) 

(132) 
(133) 
(134) 
(135) 
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then the sum-rate capacity is 
1 



log 



+ 2 log 



I + P2h2hl 



(136) 



Proof: We prove Theorem 4 from Theorem 1 instead of Theorem 2 since the optimal solution is known 
for problem (16). If we choose A, in (134) and (135), then by Lemma 3, given (131) there exists 
such that 

Af Ai ^ El = I - A2S2-iAi^ (137) 
Ai^As ^ E2 = I - AiS^^Af . (138) 

Therefore, conditions (17)-(19) are satisfied. In the following, we show that the upper bound -Riu(S'i, >S'2)+ 
R2u{Si,S2) is maximized at S* = Pi and i?i„(Pi, P2) + R2ui.P1.P2) = Rii{Pi,P2) + R2i{Pi,P2). 
From (24) we have 

Rlu + R2u 





hi 




h 








h2 




fl 




Z2 






X2G + 






X2G + 






A. 









ni 




h. 









712 



= h ifiXiG +ni)-h{ni) + h [hiXio + /2-'^2G + -Zi l/i^iG +ni)-h (/2^2G + zi |ni) 

+h (/2X2G +n2) - h (n2) + h {h2X2G + /i^iG + -22|/2-'^2G +n2) - h ifiXiG + 221^2) 

= -h{ni) + h {hiXiG + f2X2G + ZllflXlG + ni) -h{n2) + /l(^2^2G +/l-'^lG +«2|/2^2G +«2) 

(139) 

where the last equaUty is by (137) and (138) which mean 

Cov(ni) = Cov(2;, |n, ) i, j G {1, 2}, i + j. (140) 

Then it suffices to show that h {hiXiG + f2X2G + \fiXiG + Wi) is an increasing function of Cov(XjG). 
We write XiG = XiG + XiG where XiG and XiG are independent Gaussian variables. Obviously, we 
have Cov{XiG) > Cov (XiG) and 

h (hiXiG + /2^2G + 21I/1X1G + ni) 

> h (hiXiG + /2^2G + Zl \fiXiG + ni,XiG, X2g) 

= h {hiXiG + /2X2G + Zl \fiXiG +ni). (141) 
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Therefore, the upper bound Riu{Si, S2) + R2u{Si, S2) is maximized at S* = Pi. From (38), (40), (134) 
and (135), we have 



Riu{Pl,P2) — Ril{Pl,P2)- 

Therefore, the upper bound is achievable and hence is the sum-rate capacity. 

Remark 12: A simple way to choose matrix Aj that satisfies (134) and (135) is to let 



(142) 



Ai= (l + P2/2/^) h,fl 
A2= (l + PlA/f) h2fl 



(143) 
(144) 



However, this may not always be the best choice for (131). An alternative way is to let [32, eq. (39)] 



hj (l + Pjfjfj) Vi 
where Vi is a vector. Then, to satisfy (131), we need only 



(145) 



min radius < -. 



(146) 



Remark 13: Proposition 3 can also be obtained from Theorem 4. Let fi = 0, then we have Ai = 0, 
A2 = ^12/2^ and *i = 0. Therefore, condition (131) is always satisfied. Notice that (l — A2AI') ^ and 
(l — A2^A2) ^ must exist such that *i exists. By [31, Lemma 7] this requires A2^A2 ^ I which is 
(128). 

Remark 14: If the SIMO IC is symmetric, i.e., ^1 = ^2 = ^, /i = /2 = / and Pi = P2 = P, 
the noisy-interference condition is given in [32, Theorem 3]. We will show that the same result can be 
obtained from Theorem 4. Without loss of generaUty, we assume 9 e [O, f ] . The matrix A that satisfies 
(134) and (135) can be chosen as 



COS CO COS 9 



+ sm u sm ( 



cos uj sm uj 




(147) 



1 + aP 

where a; is a real number. Since Ai = A2, condition (131) reduces to radius(A) < i, i.e.. 



> mill max abs 



min max abs 





T 




\ 


COS (j) 


A 


cos (j) 




sin^ 




sin0 


/ 



y/a (cos^ (f) cos oj + COS (f) sin (f) sin cj) 



cos UJ cos 9 
l + aP 



+ sin UJ sin ( 
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^/a{l + abs(cosa;)) /2 



abs 



cos 00 COS 6 



l + aP 
y/a{l + coscj) /2 
efori] Vrsm(uj + I3) 



+ sin u sin 9 



= mm 

OJ 



where 



P = atan 



cos^ 9 
(1 + aP)2 

COS0 



+ sin^ 



0, 



TT 



(1 + aP) sin 61 
It can be shown that the optimal cj for (148) is 

if /3 G [0, f 



a; 



2 ' 



7r-2/?, if/3G[f,. 



Then (148) becomes 



a < sin^ ^ 

cos^ 9 



2-ya cos . 9 „ 
^ + sin^ 6" > 



(1 + aP)2 1 + aP 
which are exactly the conditions in [32, Theorem 3]. 

V. Numerical examples 
Example 1: Consider a MIMO IC with channel matrices: 



II 7 — < sm( 

(1 + aP) - 

otherwise 



Hi = 

H2 = 

and power constraints 



-1.4510 -1.0078 
-1.8953 0.2184 
1.9125 -1.6068 



Fo = 



0.4255 -0.1702 0.6865 
0.5133 0.1574 0.1805 
-0.4795 -0.5019 0.4648 



0.7739 1.4112 -1.8231 
1.4817 -0.4647 2.1620 



and Fi 



-0.2636 0.2981 
-0.3483 -0.1426 



Pi = 1 and P2 = 4. 

The optimal input covariance matrices for problem (3) are 

0.9458 0.1788 



0.9079 -0.2892 
-0.2892 0.0921 



and S% 



0.5314 

0.1788 0.6839 -1.0601 
0.5314 -1.0601 2.3703 
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and both and 83 are singular: 

rank(S^) = 1 and rank(S2) = 2. 
The Gi and G2 in (4) and (5) and the Lagrangian multipUers are 



Gi 



-0.3624 0.0005 
0.0005 -0.3608 



-0.1368 -0.0525 -0.0294 
-0.0525 -0.0591 0.0583 
-0.0294 0.0583 -0.1305 



Wi 



0.1740 0.5463 
0.5463 1.7150 



* 10 



-3 



Wo = 



2.6419 -5.2450 -2.9381 
-5.2450 10.4117 5.8325 
-2.9381 5.8325 3.2674 



* 10 



-2 



Ai = 0.3626 and A2 = 0.1632. 



It is easy to verify that the KKT conditions in (4)-(7) are satisfied, 
The Ai and A2 that satisfy (27) and (28) are 

-0.2821 0.4705 
0.0254 0.2073 and A2 
-0.3814 0.1588 
The Oi and O2 in (33) and (34) are 



0.0047 0.2392 
0.3215 0.2853 



-0.4520 
-0.1663 



Oi = and O2 



0. 



Therefore, (29) and (30) are satisfied. Hence the expressions for Si and are not relevant. As in 
Remark 8, we only need to show the existence of Ei and E2 that satisfy (17)-(19). We have that (71) 
is also satisfied: 

radius = 0.4350 and radius ($2) = 0.3130. 

Then, all the conditions in Theorem 2 are satisfied. Therefore, the sum-rate capacity is achieved by 
treating interference as noise and the optimal input covariances are and 83 . 
Example 2: Consider a MISO IC in the form (78) with channel vectors: 



^1 



-0.1481 




0.0201 




0.1050 




-0.4748 


-1.7969 




-0.0197 












, /i = 




, ^2 = 


-0.0523 


, /2 = 


-0.7711 


0.1331 




-0.0729 




1.8070 




0.3813 


0.6644 




0.7636 
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and power constraint 

A = A = 1. 

The equivalent MISO IC in the form (83) has channel vectors 





0.3586 




0.3985 




0.3818 




0.5426 




0.9335 







, ^2 = 


0.9242 








Si 



and S*. 



0.1345 0.6503 
0.6503 3.1445 



and power constraints 

Pi = 3.7100 and P2 = 3.2789. 
The corresponding channel parameters are 

61 = 0.38337r, 62 = 0.37537r, ai = 0.1588, 02 = 0.2944. 

The optimal input covariance matrices for the equivalent channel are 

0.2093 0.8561 
0.8561 3.5007 

The corresponding optimal covariance matrices for the original channel are 

0.0070 0.0808 -0.0071 -0.0187 
0.0808 0.9356 -0.0820 -0.2168 
-0.0071 -0.0820 0.0072 0.0190 
-0.0187 -0.2168 0.0190 0.0502 
The Gi, G2 in (4) and (5) and the Lagrangian multipliers are 

0.0929 -0.0420 
-0.0420 -0.1017 



ST = 



and S*n = 



0.0253 0.0204 0.1558 
0.0204 0.0164 0.1253 
0.1558 0.1253 0.9583 



Gi 





0.0442 


-0.0357 




-0.0357 


-0.0929 




0.1459 


-0.0357 




-0.0357 


0.0087 


= 0.1016, A2 


= 0.1104. 



G2 



Wo = 



0.2033 -0.0420 
-0.0420 0.0087 



It can be easily verified that the KKT conditions in (4)-(7) are satisfied. 
The Ai and A2 that satisfy (97) and (98) (or (27) and (28)) are 



Ai = 0.0992 and A2 = 0.1156, 



and the af and af in (91)-(94) are 



aj = 0.9874 > aj = 0.6277 
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(tI = 0.9891 >aj = 0.4643. 

Therefore, by Theorem 3, the sum-rate capacity of this MISO channel is achieved by treating interference 
as noise. 

We can also verify condition (103) with 

h = 1.0994 and k2 = 0.8133. 
The Oi and O2 matrices in (33) and (34) are 



Oi 



0.0679 -0.0166 
-0.0166 0.0041 



and O2 



0.1280 -0.0265 
-0.0265 0.0055 



Since Wj >z Oi, by Theorem 2, the sum-rate capacity of this MISO channel is achieved by treating 
interference as noise. 
The sum-rate capacity is 

R^ + R2 = 0.7533 + 0.7009 = 1.4543. 
Example 3: Consider a SIMO IC with channel vectors: 









1.1136 




0.2458 








-1.8356 












0.1583 








-0.0346 




0.0700 






^1 = 


0.0668 
0.0355 


, /i = 


-0.2537 
0.1179 


, ^2 = 


-0.6086 
-1.2226 


, h = 


-0.6714 
-0.5161 



and power constraint 



The equivalent SIMO IC is 



Pi = P2 = 1. 





-0.2234 




0.6252 




0.1764 




0.6201 


^1 = 


0.9747 


, /i = 





, ^2 = 


0.9843 


, /2 = 






with power constraint 

Pi = 3.3753 and P2 = 1.9304. 
The corresponding channel parameters are 

(pi = 0.57177r, ip2 = 0.44367r, ai = 0.3909, 02 = 0.3845. 
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We simply choose matrices Ai and A2 as in (143) and (144): 



-0.2434 
0.6094 



and A2 



0.2537 
0.6103 



We have I - AjAi - AaA^^ ^ 0, I - AiAj^ - Af'Aa ^ and 

radius = 0.2784 and radius = 0.2815. 
Therefore, by Theorem 4 treating interference as noise achieves the sum-rate capacity and 

R^ + R2 = 0.7297 + 0.5317 = 1.2614. 

We can also use Theorem 2 to verify the result. The Ai and A2 satisfy (27) and (28). The numerical 
radius condition guarantees the existence of Ei and E2 to satisfy (17)-(19). Furthermore, we have 
W\ = W2 = Oi = O2 = 0. Therefore, all the conditions in Theorem 2 are satisfied. 

Example 4: In this example, we consider the maximum value of Oj for MISO and SIMO ICs to have 
noisy interference with various choices of Pi and 9i or ipi. For the symmetric MISO or SIMO IC, one 
can use Theorem 3 and 4 to generate the same result as [32, Fig. 2]. For the SIMO ZlCs, the maximum 
02 is 1 regardless of Pj and (p2 by Proposition 3. For the MISO ZIC, the maximum 02 is shown in Fig. 
2 by Proposition 2. 

Example 5: In this example, we show that a MISO ZIC in which the noisy-interference conditions in 
Proposition 2 are violated and treating interference as noise does not achieve the sum-rate capacity. 

Consider a MISO ZIC with Pi = 1, P2 = 10, ai = 0, 02 = 0.4, = f and 6*2 = f . As is shown 
in Fig. 2, this MISO IC does not satisfy the noisy-interference condition. The maximum sum-rate by 
treating interference as noisy is 

Ri + R2 = 1.3725 



and is achieved by (108) and (109): 



1 




and S9 = 



1.7566 3.8053 
3.8053 8.2434 



However, we consider a Han and Kobayashi achievable rate region [6], [7] for the MISO ZIC: 

Pi < ^ log I 1 + ^ I 

-2 



R2 < ^log {l + hl{Sp + Sc)h2) 
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where Sp and Sc are respectively the covariance matiices for the input vectors that carry the private and 
common messages. Then we can achieve a sum-rate of 



Ri + R2 = 1.4093 



by the same and a different = + S* with 

1.1542 2.2652 
2.2652 4.4458 



S* 
p ~ 



and S* = 



4.1906 0.9367 
0.9367 0.2094 



VI. Conclusion 



We have studied the noisy-interference sum-rate capacity of MIMO ICs. Sufficient conditions for a 
MIMO IC to achieve the sum-rate capacity by treating interference as noise have been obtained. For the 
special cases of MISO and SIMO ICs, simpUfied conditions have been derived. These conditions largely 
extend all the existing sufficient conditions. 



Appendix 

A. Proof of Lemma 1 

If we write the optimization problem in the standard form: 

min / (x) 
subject to (a;) < 0, i = 1, - ■ ■ ,m 
X e X 

then CQ5 in [39, p. 306] requires that there exist a vector y e Nx {x*)* such that 



(153) 



(154) 



where a;* is optimal for problem (153), Vffi (^*) is the gradient of gjix) at x*, Nx {x*) is the normal 
cone of X ntx*, Nx {x*)* is the polar cone of Nx {x*), and A {x*) is index set of all the active inequality 
constraints. Applying this theorem to our case, we need to find matrices Kj, i = 1,2, such that 



G Ns, (S*)* = Ts, (S*) 
tr(Ki)<0 iftr(S*) = Pi 



(155) 

(156) 
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p,=o.i 




0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0. 

'WK 



Fig. 2. The maximum value of a for a MISO ZIC with Pi = 1 to have noisy interference. 



where Si is the set of symmetric positive semi-definite matrices with the same dimension as that of S*, 
and Ts^ (S*) is the tangent cone of Si at S*. The equaUty of (155) is due to the convexity of Si and [39, 



Proposition 4.6.3, p. 254]. 

Define a sequence of matrices {Y^}: 

Yfc = Sl-iu-diag[77i,0,--- ,0]-U^, k = 1,2 (157) 

where U is a unitary matrix associated with the eigenvalue decomposition of S\, and r/i is the largest 
eigenvalue of S*: 

S* = U-diag[r/i,772,-- - ,r/tJ-U^. (158) 

Obviously, we have 

{Yfe}C5i, Yfc/S* (159) 
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lim Yfc = (160) 

k—^oo 

y Yfc-St _ -U-diag[7?i,0,--- ,0]-U^ 

k'-^oo llVec {Yk - SI) II llVec (U ■ diag[r?i, 0, ■ ■ ■ , 0] ■ U^)|| " ^ ^ 

Therefore, by [39, Definition 4.6.2, p. 248] 

Ki ^ -U • diag[r?i, 0, • • • , 0] • G Ts, (S*) . (162) 

Since rji is the largest eigenvalue of S^, we have 

tr (Ki) = -ni<0 if tr(St) = Pi > 0. (163) 

We can similarly find K2 satisfying (155) and (156) for 82- Therefore, the constraint qualifications are 
satisfied and there exist Lagrangian multipliers and satisfying (4)-(7). 

B. Proof of Lemma 2 

To prove that the objective function of problem (16) is concave over Si and S2, it is equivalent to prove 
that (23) is concave. By [31, Lemma 1], both the conditional entropies h (HiXig + F2X2G + Zi\FiXig + ni) 
and h {^.2X20 + FiXig + ^2|F2a:2G + 12) are concave. Therefore, by symmetry, it suffices to prove that 
h {FiXiG + ni) — h {FiXiG + Z2\n2) is concave over Si and S2. 

From (20) we have Cov {Z2\n2) = I — A25^^^A2. From (18), there exists a Gaussian vector v ~ 
A/" (0, ^) where 

1:= (I- A2S2-iAi^) - El. 

We further let z be independent of all other random vectors of interest, and then we have 

h (FiXiG + ni) -h (FiXiG + «2|n2) = h (FiXig +ni) - h (FiXic + ni + u) 

= -I{v;FiXiG+ni+v). (164) 

Define a binary random variable Q with probabihty mass function Pr{Q = 0) = q and Pr{Q = 1) = 1—q 
where < g < 1. Let xi have mixed Gaussian distribution with conditional distribution 

(165) 



\p{x,\Q = l)=plxf^)r^Mlo,sf^) 



p{xi\Q) 
where 

Si = gSi') + (1 - (/)sf \ (166) 
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Then we have 

-ql (y; Fix'i^ + m + - (1 - q)I (v; FiX^^^ + ni + 
= -7(«;FiXi +ni +v\Q) 

= -h {v\Q) + h {v\FiXi +ni+v, Q) 

(a) 

< -/(«;Fia;i +ni+v) 

< -/ (v; FiXiG +ni+v) (167) 

where (a) is by the assumption that Q is independent of v and the fact that conditioning does not increase 
entropy. In (b), we let Xiq ~ Ar(0, Si). The inequahty is by (166) and the fact that Gaussian noise is 
the worst additive noise [43]. Therefore, h{¥iX\G +ii) — h{FiXiG + «2|«2) is concave over Si and 
S2. Similarly, we can prove that h (F2X2G +n2) — h {F2X2G + ^iliii) is also a concave function of Si 
and S2. 

C. Proof of Lemma 3 
In the proof of [31, Lemma 9], if radius (*i) < |, then there exist XI 1 that satisfy 

El = I - Ai (I - AiE-i Af ) A2 (168) 

and El — A^Ai is positive definite. Then it suffice to prove that I — Ai'S^^Aj is positive definite since 
we can substitute Ei defined in (168) into (75) and obtain a positive definite E2. 
Let El = Af Ai + X where X :^ 0; then we have 

E2 = I- AiE^^Af 

= I- Ai (X + AfAi)"^Af 

^=^I-Ai (X + TAT^)~'Af 

I - Ai + TAT^) Af 

= I - AiT (r/I + A)-^ T^Af (169) 

where in (a) we let AJAi = TAT^ be the eigenvalue decomposition of A^Ai and TT^ = I and A 
is a diagonal matrix with non-negative diagonal elements. In (b), we let 77 be the smallest eigenvalue of 
X. Since X is symmetric positive definite, we have 77 > 0. The inequality of (b) is by the fact X y r]l. 
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Since I — B^B is positive definite if and only if I — BB-^ is positive definite, we only need to 
prove that I — (r/I + A)"^ T-^Af AiT (ryl + A)~^ is positive definite, which is obviously trae since 
T^Af AiT = A and r? > 0. 

We have proved that if radius ($i) < i, then there exist Si >~ AJAi and ^ that satisfy (74) 
and (75). Now we need to prove that >- A2 A2, which is true by the fact I — A2X;2 ^-^2^ = 5]i ;^ 
and [31, Lemma 6]. 

By symmetry, if radius (^2) < 5, we also have positive definite solutions. The equivalence between 
(76) and (77) is by [31, Lemma 6]. 
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